Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

[FFN Fusion] Support FFN_fusion for the ChatGLM2 #142

Merged
merged 11 commits into from
Mar 4, 2024
Merged

Conversation

Zhenzhong1
Copy link
Contributor

@Zhenzhong1 Zhenzhong1 commented Feb 27, 2024

Type of Change

New feature

Description

Support FFN_fusion for the ChatGLM2

perf
image

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

@Zhenzhong1
Copy link
Contributor Author

Zhenzhong1 commented Feb 27, 2024

@Zhenzhong1 Zhenzhong1 changed the title Zhenzhong/glm2 ffn [FFN Fusion] Support FFN_fusion for the ChatGlm2 Feb 28, 2024
@Zhenzhong1 Zhenzhong1 changed the title [FFN Fusion] Support FFN_fusion for the ChatGlm2 [FFN Fusion] Support FFN_fusion for the ChatGLM2 Feb 28, 2024
@Zhenzhong1 Zhenzhong1 marked this pull request as ready for review February 28, 2024 06:21
@Zhenzhong1 Zhenzhong1 requested a review from a32543254 February 29, 2024 05:27
Copy link
Contributor

@a32543254 a32543254 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@VincyZhang VincyZhang merged commit 96fadd9 into main Mar 4, 2024
11 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants